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ABSTRACT 

This study compared the results of four different 
methods of observing teacher training. In addition, it used the 
results to identify those training techniques which seemed to be 
betters at changing* teachers^ behavior in their classrooms . 
Twenty-nine teachers were trained by five trainers in five weekly 
training sessions, which were tape recorded. The recordings were 
analyzed using these observation methods: (1) Trainer Citation of 
Observation Variables; (2) Flanders Interaction Analysis; (3) B. O. 
Smith's [Analysis of the Logic of Teaching; and (4) Content Analysis. 
The dependent variable was based upon pre- and post-training 
observations of the teachers in their own classrooms. The findings of 
the four observation methods, while consistent, revealed different 
facets of the training experience. The most accurate predictor of 
resulting teacher change was the total number of Trainer Citations of 
the Observation Variables, but the framework for the model, the 
structure of the trainer's interactions, relied upon the Flanders 
Matrix. B. 0. Smith's analysis gave a glimpse into the processes that 
take place between the trainer and teachers, and how a teacher is 
induced to change. The Content Analysis identified those areas of 
training that appear to be the most useful to teachers in enabling 
them to change their teaching behaviors. Fourteen tables are included 
i n the report. (Author/JD) _ _ 
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OVERVIEW 



During the fall and winter of .1981-82, " twenty-nine junior high teachers 
in the District of Columbia Public Schools were trained in a program called 
Academic Learning Time which taught methods for improving student achievement 
with a focus on the effective use of time in the classroom. The 
program was based on training designed by Dr. Jane S tailings, entitled, 
The. Process of Teaching -Basic Reading Skills in Secondary Schools* 

The involved teachers represented various content areas: nine in mathe- 
matics, seven in science , six in English, three in history, two in reading, 
ond in industrial arts, and one in French, but the emphasis was on reading 
skills in those areas. The teachers were personally asked if they would like 
t$ participate in training by their principal or regional supervisor. In 
gerieral, they were selected because of their leadership potential^among their 
peers. Eight teachers were selected from each of the four regions of the ----- 
school system, and at least two teachers came from any one school. Teachers 
were given two in-service credits for the training, which took place after 
school for 2/2 hours one day a week for five weeks; they were given no other 
compensation. 

The topics of the five workshops were: 

I. Overview of the Research on Teacher Effectiveness 
fii Strategies for Teaching Reading 
III. Classroom Management 
IV. Behavior Management 
V. Feedback and Direct instruction. 
The training is designed for one trainer to work with, a small group: 



a session, attempt to apply the -tjScbhiques in their classes during the week^ 
then return to the- workshop and freely exchange their experiences* Thus the 
emphasis is both on (l) content and (2) sharing of experiences. ; - 

The training model used 0 in the District of Columbia not only trained the ? 
teachers but also trained four supervisors, one from each region, to be 
trainers* This was accomplished by having a consultant/teacher 
trainer, who is associated with the S tailings 1 Teaching and Learning Institute 
train a group of teachers on Monday afternoons" while the four apprentice train 
ers observed. The next morning the consultant met with the trainers in effect 
to train them. That afternoon, Tuesday, each trainer met with the teachers 
from her region and trained them under the supervision of the consultant „ 

The training groups were intended to be equal size; however, because of 
scheduling difficulties, eleven teachers were allowed in the consultant's 
-group ;-xeported_in_tfis paper as group 5« The size of the other trainers 1 
groups were: three in g^oup 1, six in group 2, four in group 3i and five in 
group *f. " 

Before and after the training each teacher was observed with one class 
for three different sessions by observers using the Stallings 1 SRI Secondary 
Observation Instrument. This observation provides detailed information on 
teacher interactions every fire seconds in the classroom. The information 
is reported in terms of frequency of occurrence for nineteen variables on 
the Five Minute Interaction (FMI) report, and in the percentages of time ; 
spent on different interactions on the Snapshot report. These pre and post 
data on the teacher behavior in their classrooms provide the dependent 
variable for this study. The degree to which teachers alter their teaching 
from the pre 'training observation to the post training observation is the 
measure used to assess the impact of the five different treatments^ or 



Rather than : fa&ve an observer sit in on each of twenty-five workshops 
(five workshops over -fi*/e weeks), it was decided to tape record each session 
ani to use that as fchfi basis for the teacher training observations. A precedent 
has been established for using transcripts to assess behaviors in work such 
as that by Smith, Wright 9 and Flanders (Medley and Mitzel) , and a tape recorder 
is a relatively unobtrusive participant. 

None of' the. .established methods for observing teacher behavior was en- 
tirely satisfactory.,, taken by itself* Each provided a different perspective 
of what ; was happening in the training. If the theory underlying the method 
did not measure the aspects of training * that in fact . were causing the changes 
in the teachers' behaviors , then the study would reinforce the opinion of 
just one of the "blind men studying the elephant." It was determined that 
an eclectic approach for observation would be used with different observation 
methods. This approach would provide a more complete picture by measuring 
what actually occurred in different complementary ways. Each method could 
also serve to validate or refute findings of another methods If similar 
results came from two different methods, then one could be fairly confident — 
of the findings. Additionally, using different observation methods would 
provide an indication of which method was most predictive of the changes in 
teacher behavior. 

Four methods of observation were selected: (l) Trainer Citation of 
Observation Variables, (2) Flanders' Interaction Analysis, (5) B. 0. Smith's 
Analysis of the Logic of Teaching, and (k) Content Analysis, 

It would seem that the measure which theoretically would most accurately 
predict ^teacher change on any of the thirty-one classroom observation variables 
would be the ajaount of emphasis that the trainer put on each of the variables, 
measured by counting the trainer references to eg.ch one. This trainer behavior 



wi^ong with this* especially if it serves to sensitize- teachers to which 
classroom variables have the greatest impact on achievement. The measure 
of trainer citations should also reflect the trainer's conscious or sub- 
conscious concern or sense of importance of that variable. Whether or not 
this concern transfers to the teachers 1 behavior is directly measurable. 

Flanders, in his studies stressed the importance of teacher-student 
interactions, and this is also 'stressed in the Stallings training. By - 

measuring the training using Flanders' method, it can be seeh whether teachers 

* 

who are trained with more interactive methods begin to teacher their students 

with more interactive methods. 

B». 0. Smith in his study of the logic of teaching was . seeking to discover 
if the type* of teacher discburse had an effect on students, in. transfering 
his model to teacher training/ it can be seen whether teachers learn and 
translate to behavior better when questions are directed to them of an eval- 
uative nature * rather than ..a defining or describing nature, for example; 
The B» 0. Smith analysis may give the best insight into what expectations 
the trainer has of the teachers within the workshops. 

Finally, the content analysis will catalogue what the trainers said to 
the teachers. Their stress oh the various aspects of effective teaching and 
their adherence to the traiSirig program can be used to structure an idealized 
model for training, much as Dr. Stallings developed an idealized model for 
teaching. 

One interest of this study is to learn whether or hot time-on- task is as 
reasonable an approach to observing teacher training as it is in the classroom. 
A simple time-on- task observation of the tapes indicates that the trainer and % 
teachers are rarely off-task; of course^ it isn't possible to Jee who might 
be daydreaming. And total tape time of the workshops isn't a valid "measure 
because for one workshop* the tape was Inadvertently not turned on for the 
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second half of the workshop * and in all workshops the. tape recorder was 

turned off occasionally for reasons of confidentiality i qbffee breaks, etc. 

The verbal behavior of the -trainer and teachers can be measured, however* 

with attention paid to the content of training, to the use of time, and to 

effective training practices. 
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CHANGE IN TEACHER CLASSROOM BEHAVIOR 

The first step in the analysis was to examine the results of the pre and 
post training observation scores, shown on table 1. These scores are based 
upon the frequency of occurrence of each variable during a forty-five minute 

class period. The first variable, All Academic Statements, is a sum of the 

- - - - 1 

next ten variables, excepting Teacher Corrects and Guides* The criterion 

for the"' frequency of occurrence is an idealized situation which realistically 

expects some negative activities, such as behavior statements * to happen in c 

a classroom. 

The frequencies reported for the £. C. teachers were adjusted to more 
closely reflect the total frequency for the criterion (188) . ' This was im- 
portant for comparison reasons. Just as important , however , it was necessary 
to balance the totals of the pre and post observations which^ prior to ad- 
justment, were 282 for the pre observation, and l$k for this 'post observation. 

The large total in- the pre observation seems to indicate a flurry of 

activity. It may be that the teachers, as yet unfamiliar with the program, 

. _ . - - _ . . . . . 

were quite anxious and did all things at once during the initial observations. 

Another possibility for the difference in the pre and post frequencies is that 

for the pre observations, .the observers werjl newly trained, and also working 

under a tight schedule for completing the required number of observations. 

This was not the case-, four months later, when the post observation were 

conducted. One effect of the -high pre observation scores was to give the 

trainers and teachers an inflated view of how they were doing without any 

training • 

Note that the observations for each teacher were ^^ucted by a trained 
observer as well as by their regional supervisor who nay have also been their 
trainer. \, 

1# Ihis does hot hold true for the pre observation scores with which other 
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ERjC L rhe riuicbers for the pre-ttaining and post-training have been adjusted proportionally tc approximate" 
the nunfcer of interactions in' tfie criterion (188). 



A second format which was part of the classroom observations was the 
SRI Classroom Snapshot in which the oWermr scans the room noting what 

3 

\ all persons are doing at one point in time. The variables for the snap- 

shot are reported as percentage of occurrence* see table 2* 

_ _ ■ \ . __ . _ _ _ __ • 

It can be noted on both tables that the tealhers did change their 

behavior between the pre and post observations • On some of the variables 

the teachers increased the frequency- (shown as a positive difference) and 

on others, they decreased the frequency (a negative difference,).. This 

©ould be expected since there is only a set amount of time during a class 

period, and to increase one- variable could diminish another. The question 

to be examined is whether the change was in the direction taught to them 



during the training*. 

What the teachers were instructed" to do came from three sources • (See m 
table 3. 5 It was explained to them which variables were .positively and 
which negatively correlated with achievements Additionally., based on the 
pre observation profile, each teacher was told to (l) increase ^ (25 con- 

- tinue at the current level, -or (3) decrease the number of interactions he 
or she had on each variable*' The teachers had the given criterion for each 
variable and were told to approach it in their teaching. The picture became 
slightly more " confusing for any teachers who had academically high classes, 

; because they needed to follow other recommendations , such as not reducing 
silent reading. To synthesize the various sources of recommendations , 
teachers were told to personally try to attain a balance that is correct 



for. themselves in that class in applying the research findings. 

A simple coun^ of the direction of the teacher change shows that for 
the correlation to achievement, teachers increased or decreased interactions 
in the recommended direction oh t$n of the thirteen variables T For the 
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table £ ; 

MCMIABES OF OBSERVED TIME ON SNAPSHOT VASIABISS 



Observation Variables 


Criterion 


D; Ci Teachers 
Pre Saining 


D. C. Teachers 
Post Training 


Difference 


Reading Silently 


15.00 


1.28 


1.06 

1 


.-.22,' 


Reading Aloud 


6.00 


J- 1.92 


5.29 


3.37* 


Making Assignments 


10.00 


5.65 






Instruction/Explanation 


25.00 


26.05 


35.19 


9.16* 


Discussion/Review Assignment 


s 10.00 


15.30 


17.20 


1.90 


Practice Drill ' 


fcou 


3.to 


2.98 


=A 


Written Assignments 


20.00 


19.96 

• 


15.92 


4$ 


Taking Test/Quiz . 


5.00 , 


3.3^ . 


^09. • , 




Social Interaction 


. .00 


f 6. T l8 ; . i 


2.22 . 


* -3.96** 


Student Uninvolved 


.00 


i '7.20 


2.53 


4.66* 


Being Disciplined 


,00 


' .31 ; 


*■' .09 


-.22' 


Classroom Management 


5.00 : 


7.50 


4.52 . 


-3.18 



,01 

.05 
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instruction and teasher behavior to mcmsa or decrease variables 

Observation Variable Correlation to • Instructions To Approach Direction 

Achievement to Teachers (number) Criterion Teacher Change 

_ _. (+ positive: current (4 more (significant) . 

Five Minute Interactions - negative) more . is a.k, less - less) (+ more, - less) 

All Academic Statements ' + 9 20 0 . + ' + ** 

Teacher Asks Direct Questions + 0 29 0 - - ** 

Students Respond + 2 27 0 ■ - ** 

Teacher Corrects and Guides + 2 2? 0 - - ** 

r 

Students Read Aloud + 29 0 0 + + * 

Teacher Reads Aloud + 28 - • 0 0 + + * 

All Organizing or Managing Statements - 0 11 16 non sig. - . ** 

in* Alone - 0 6 f $ - - ** . 

.ve interactions + 25 k ,0 + . 1 + ** 

Snapshot 

Reading Aloud + 18 I 0 + «' + * 

Instruction/Explanation + 11 11 0 non sig. + * 

Social Interaction - 0 5 17 - ** 

Student Uninvolved - 0 3 19 - - * 

= .01 



* instructions to teachers, ten of *the thirteen variables agreed and the 
remaining three were given as currently o;k; The direction of teacher change 
agreed with all twelve of the changes indicated for approaching the criterion; 
It would appear that, teachers did heed their individual instructions as well 
as begin to approach the criterion in their interactions - m 

It isn't likely, however, that the teachers sought to reduce certain 

I , ■ - - - 

positive variables such as, Students Respond, for the purpose of replicating 

the" criterion in their own classes. What is more likely is that those inter- 
' actions were reduced as teachers put more emphasis on other variables. In 
no case does the teacher 's instructions contradict the correlation to achieve- 
ment. In several cases, however, the criterion contradicts the other two 
categories. 

For the purposes of this study, the direction of the recommended change 
will be based upon the correlation (positive or negative) with achievement. 
The quantity and magnitude of- these changes in the given positive or negative 
direction will be used to compare the five training groups using the different 
observational techniques • 

Table k shows the significant changes in the number of teacher interactions 
by their training groups. All five of the groups made significant overall * 
improvement as shown in the number of academic statements made in class i 
Additionally, the teachers in Group 1 increased Teacher' Praises or Supports, 
and Positive Interactions. It will be interesting to note from the Slanders 
analysis if their trainer' "was also high in praising and supporting them. 

The distribution of changes for Group 2 .on the FMI variables closely 
resembles the patterns for Groups k and 5. Note additionally, that Group 2 
teachers were the only ones to significantly alter the Snapshot variables. 
This could indicate that for the other training groups , the trailing was 

17 
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CEANGES IN TEACHER BEHAVIOR BY TRAINING GROUP 



Observation Variable 
Fiv e Minute Interac 



All Academic Statements 
Teacher Asks; Direct Questions 
Teacher Galls Upon Different Students 
Students Respond ■ 
Teacher Praises or Supports 
Teacher Corrects and Guides 
Students Head Aloud 
Teacher Reads Aloud 
All Organizing or Managing Statements 
Teacher Working Alone 
Intrusion • 
Positive Interactions 



Reading Aloud 
Making Assignments 
Instruction/Explanation ■ 
Written Assignments 
Social Interaction 
Student Uninvolved 



Group 1 
n a % - 



** 



Group i Group. 7 j Group h Group 
n = 6 n = 4 n = 5 n = 



**. 



2 



- * 



+ 



_ ** 
_ * 



** 



** 



** 



** 



1; Group 3 was trained by the consultant, 

^ These changes were not in the direirtioii -indicated by the correlation with achievement* 
( + a increase, - = decrease) 

**/= .01- '■■ 
**= .05 



: a nbn-adaptational model in that teachers increased or decreased the 
frequency of certain variables^ but did not alter the proportions of time 
given to different activities; The other groups did make some changes as . 
shown by the significance levels for all groups combined. 

The kinds of changes made by Group 2 teachers in the Snapshot variables 
were to decrease Social Interactions and Students Uninvdlved. This may have 
reflected the increase in Written Assignments, but the students were attending 
to their writing. Group 2 teachers were also successful in reducing... their time 
spent on Making Assignments. 

Group 3? which resembles Group 1 in increasing the Positive Interactions, 
also significantly reduced the interactions of Teachers Asking Questions and 
Students Responding, as did Groups 2, 4, and 5.' The Flanders and B. 0. • Smith 
analyses may shed light on the training experiences of teachers and the 
question-answer behavior of their trainers • 

Group 4, similar to Groups 2 and 5, reduced the Teacher Correcting and 
Guiding behavior and time spent with Teacher Working Alone. Group *f teachers 
were unique in significantly increasing the numbers of different students 
they called upon. Note that the number of Students Responding declined. 
This may have been because slower*: students were now being called upon, and 
fewer total student answers were possible. 

Training for Group 5, conducted by the consultant, operated as a model for 
the other training groups, which may explain the resemblance of Groups 2 and *f. 
The consultant, in addition to establishing the model for change, was success- 
s ful in. having teachers reduce their Organizing and Managing Statements • 

From the profiles of significant change by group, it is not possible to 
assert that any one training experience was without question better than 
another. For this study it would be useful to be able to rank the training 
groups in order to compare them to the ranks derived from the observational 



• « 

methods* For that purpose ^ tables 5i 6 and 7 were developed^ fable 5: 
gives the pre arid post observation means on eacli variable for each group. 
Table 6 shows the results of analysis of cb variance and provides ah adjusted 
post observation mean. The amount of change in the teachers' classroom 
behaviors on each variable from .the pre observation mean to the adjusted 
post observation mean is divided by the pre observation mean to give a 
measure of magnitude or percentage of change teachers made in their classrooms . 
When a correction is made to enstire that teacher changes are in the recom- 
mended directions (increase variables positively correlated with achievement, 
and decrease variables negatively correlated with, achievement) as done in table 
7, then rankings by group do emerge. 

For the FMI variables , given as frequencies, Group 5 had- the greatest 
magnitude of change and was ranked first, Group 3 'ranked second, Groups 1 and 
2 were very close and ranked third and fourth respectively, and Group k ranked 
fifth. The rankings turned on the variables, Teacher Reads Aloud (TEA)" and 
Positive Interactions (PI). For PI, the changes in Groups 1 and 3 were so great 
(see table 5) that Group 3 was catapulted to the second rank, and Group 2 
: was greatly augmented despite the fact that Group 2 had actually declined a 

small amount (.21 to .18). The problem was caused by using an analysis of 
covariance with groups of unequal size and widely different pretest to post- 
test scores. 

The results of the analysis of the Snapshot variables*., given as percen- 
tage s 4 gives Group 2 the first ranking, followed by Groups 3* 3v ^(i 1 res- 
pectively. The fifth ranking of Group 4 remains the same a£ the FMI ranking. 
These rankings turn on the variable, Reading Aloud (RA) , which places; Group 2 
in the first, rank. 

Because of the problem with the widely divergent magnitudes of change 
caused by the analysis of covariance, the percentages are converted to ranks „ 

er|c 21 
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ERE AND POST OBSERVATION SCORES BY GROUP* 



Variables with Acronym 
frequencies — ' 



Pre Observation Mean 
Grp 1 Grp 2 Grp 3 



Post Observation Mean 



All Academic Statements-AAS 59.23 %% 56.28 56.91 53.05 

Teacher Instructs/Plains-© 24U9 11.9? im 2?.27 20.83 

Teacher Asks Direct Questions-TADQ 27.54" 22.80 27.30 16.88 18.75 

Teacher Asks Clarifying Questions-TACQ 1.22 0.82 0.00 1,09 0.78 

T. Calls ••Upon Different Students-TCUDS 12.30 13.74 6.14 7.24 6.58 

Students Respond-® }}M 31.28 29.93 21.85 25.76 

Teacher Praises or Supports-TPOS 6.8l 11.34 9,10 10.37 8.l6 

Teacher Corrects-TC _ 2.11 5.24 3.85 2.92 2.41 

Teacher Corrects and Guides-TCAG 5,57 13.57 10*. 9.83 7.15 

Students Read Aloud-SRA 0.24 2.02 1.75 0.00 0.77 

Teacher Reads Aloud-TRA 0.00 0.04 0.00 0.00 0.01 

All Organizing/Managing Statements- A00MS-7. 99 -U.42 -9.05 -9.6? -13.03 

•7,75 -8.32 -6.34 -6.22 -14.24 

■7.19 -6.51 -7.76 -2.96 -9.17 

1.02 -2.30 -2.50 -1.15 -1.68 



92.81 85.02 79.31 

23.23 9.58 17.90 

•18.13 19.51 19.62 

I. 97 6.6b Oi68 
9.61 11.08 6.82 

$M 23.18 ikM 

II. 32 9.79 6.63 
3.26 5.39 *iJ 
3.06 3.06 1.50 

U5 i08 

0.00 0.84 0.07 

-3.13 -9.89 -12.94 



87.02 88.38 

20.63 22.86 

12.66 14.54 

0.48 O.58 

8.98 7.39 

15.79 17.80 

7.70 7.75 

2.21 3.91 

1.66 2.96 

9.43 2.63 

1.06 0.18 
-7.12 



Teacher Working Alone-WA 
Teacher Monitoring Written Work-TMWW 
All Behavior Statements-ABS 
All Social Statements-ASS 
Intrusion-I 

Positive Interactions-PI 
Negative Interactions-NI 

percentages : : 

Reading Silently-RS 
Reading Aloud-RA 
flaking Assignments-MA 
Instruction/Explanation-I/E 
Discussion/Seview Assignments-DRA 
Practice Drill-H) 

Written Assignnents-WA 
Taking Test/Quiz-TTQ 
Social Interaction-Si 
Student Uninvolved-SU 
Being Disci|)lihed-BD ; 
Classroom Management-CM 



-0.09 -0.12 0,00 -0.05 -0.18 

-1.49 -0.80 -0.45 -1.61 -0.86 

1,29 0.21 0.17 0,59 

-0.07 -0.09 -0.52 0.00 -0, 



0.00 -0.31 -1.69 

-2.19 -3.48 -9.75 

-0.39 -1.97 -4.31 

-0.16 -0.10 0.00 

-0,35 -i.5o -0.48 

8,26 0.18 1.60 

0.00 -0.03 0.00 



-0.62 -1.57 



-2.25 -0.94 

-0.10 -0.12 

-2.25 -0.95 

I.47 ZM 

0.00 0.00 



-1.77 -0.65 -4.15. 0.00 -1. 

0.23 0.50 5.50 1.24 2.16 

-7,87 -5.53 -5.63 0.00 -7.69 

33.93 19.92 17.65 30.50 28.27 

12.57 10.50 25.25 26.96 :,9,?5 

13.63 0.37 1-75 0.00 4.41 

-11.93 -12.75 -14.98 -25.94 -25.18 

3.20 ■ 3.93 6.85 0.00 3.30 

-2.67 -10.20 -8.88 X% X% 

-3.10 -22.23 -4.75 -1.56-3.56 

0.00 -0.67 -0.78 0.00 -0.18 

-2.07 -10.55 , -1.78 -8.10 -9. 



-0.37 0.00 -5.42 -0.14 

,5/50 4.78 4.52 5.82 

-6.33 -1.17 -13.53 -4.84 -7.38 

44.23 33.93 33.38 35.46 33.94 

12.97 12.83 27.25 19.12 16.22 

8.80 0.05 0.00 iM 4.75 



-9.8O -22.12 

4.10 ;5.12 o;oo 1,56 ,6.15 

0i0O -1.88 -3.63 S2C02 52,58 

-0.13 -3.95 -1.35 -4.20. -2.09 

0.00 0.00 0.00 -0.10 -0.19 

-7.62 0.00 -5.86 -3*37 



^-'iabies which were to be decreased were entered as negative numbers, 
n there would fce fewer interactions and 



If the teachers responded appropriately' 23 
for negative variables. 



Variables Covariant 
by Acronym . Effect 
frequencies (d,f.=l,23) 

MS 1.177 ; 

m 

TAfiQ 

TACQ 5.123 

Suds 8.497 

SR 14.384 

TPOS 3.22? 

TC 3.Q83 

TCffi o,3?7 

SPA 0,051 

TRA 4,119 

AOOMS 5.139 

m 

ABS 

ass g.$6 

I 3.9^ 
PI 

1 

, Percentages 

RS 0.278 

SA 0.9$ 

MA 2.811 

I/E ' 0.494 

DRA • 0.322 

PD 1.130 

WA 3.378 
0,528 

SI ■ 8.067 

su 4.716 

BD , 0.C76 

CM . 
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ADJUSTED POST (MOT SC03B ID MACOT! OF CHANGE BY GR0 T J? 



Adjusted Post Observation Mean Percentage of Change 



Correlation 
with Ach; 



{d,f.=4,23) Grp 1 Grp 2 Qr p J-frpX- 



4.221 

3.044 
3.l8l 



3.36? 



1.990 
2.133 
0.83? 
1.695 
1.252 



1.333 
1.631 

1.914 



91.48 84.94 

£2,44 11,10 

15.63 18;?2 

1.86 0.58 

8.97 10.1? 

22,60 22.06 

12.00 9.18 

3.56 4 C 86 

2,93 3.23 

0A3 m 

0.09 0.58 

-3,88 -9.79 

-0.48 -0.66 

-2,18 -3.69 

-1.47 4.19 

-0.16 -0.10' 

-0,13 -1.58 

5.61 1.3a 

0.00 -c.o4 



78.99 86.48 89.15 

18.33 22.70 

11.22 14;47 15.60 

0.86 0.40 0.58 

?.29 9,24 7.77 

13.77 17.57 18.38 

6.65 7,37 8,05 

I.83 2.30 4.13 



54.$ 

-7.2 -6.9 

-43.2 -17,9 



iM m kn 

0.17 i.16 : 0.23 

•13.43 -7.53 -6.62 

-2.49 -1.45 -0.58 

-9.55 -5.03 -5.4? 

-3.24 -3.i4 -1.06 

0,01 -0.09 -0.13 

-0.72 -1,96 4,00 

2.90 1.30 2.12 

0.00 0.00 0.00 



27.1 -26.0 
33.1-29.5 

76.2 49.6 

-7.3 

.4 -76.2 

• 79.2 80.7 

0.0 13.5 

-51.4 -14.3 

-93.8 -92.1 

'-69.7 -43.3 

'44.1 -48.3 

77.8 -16.7 

-91.3 . 97.5 

334.9 

4.0 -55.6 



4o.$ 52.0$ + 

3.4 -29.3 9.0 + 

-58.9 44.3 -16.8 + 

0.0 - 63.3 -25.6 ; + 

18.7 27.6 18J '♦: + . 

-54.O -19.6 -28.6 + 

-28.9 4.3 +" 

-52.5 -21,2 71.4 ; * 

-85;4 -82.8 -59.6 - +, 

118.3 0,0 251.9 + 

0.0 0.02200.0' - + 
48.4 -21.6 -49.2 

-60.7 -76.7 -95.9 ' - 

23.1 69.9 -40.3 

29.6 l?3.o -36.9 . - 

0.0 80;0, -27.8 

60.0 21.7 16.3 

120.3 241.9 + 
1,0 0,0 4.0 



2.001 
0.066 
2,136 

0.261 
0.877 

0,722 

1.067 

0.542 
0.686 
I.067 
0.090 



0.01 35.38 

4.35 5.06 

-5.68 4.21 

43.48 34.52 



9.53 -0.16 



4.07 -0,66 

4.01 -0.71 

0.01 -OiOl 

-3.79' -fctf 



0.06 -5.44 -0.1V 

5.89 4.31 5.90 

43.54 -6.53 -6.78 

34.18 35.04 33.72 

27.91 19.89 15.84 

-0.11 1.24 4.82 

47.62 -9.8344.19 

O.76 0.84 6.15 

-2.81 -2.52 -3.03 

4,8? -5.4i -2.87 

-0.01 -0.09 -0;19 

-5;93 -3;55 



-100.6 -4i.5 
17.9 912.0 
-27.8 -78.1 

28.1 73.3 
1.7 19.1 

-30.1 -143.2 

6.0 - 93.5 

27.2 33.6 

-59.9 ' -93.5 
-67.4 -$.8 

0.0 -98.5 

83.1 -24.5 



-101.4 0.0 -86.5 

'7.1 2^7.6 173.1 

140.5 0.0 41.8 

93.7 15.3 19.3 

10.5' -26.2 62.5 

•106.3 0.0 " 9.3 

17.6 -62.1; -43.6, 

-§8.9 0.0 86.4 

-68.4 -44.5 -35.7 

-6di 246,8 49.4 

-98.7 0.0 5.6 

■136.0 -26.8 -61.2 



+ 

+ 



table ? 



frequency' 

(In vit it Ik 1 A 

MTldUW— 


\tm.) 

GriD 1 Grp 2 


Grp 3 '■ 


Grp 4- 


-Grs-5- 


AAS 






■ kr\ hi 






TIE 
TilDQ 


✓ ■ 






10 7 

'-290 


on 


-17.9 


-53.9 


-14.3 




TACQ 


52.5' 


-29.3 
-26.0 


0.0, 


-0-3.-3 




TCUDS 


-22.1 


18-7 


27 6 


18.1 




-53.1 


-29.5 


-54.0 

✓ * 


-I9.6 


^28.6 


•TPOS 


76 ? 


-H-if 


-2o,9 


-2(5.9 


-10 


!C 


6fl 7 
00./ 


/ V 


-52i5 




"1.7 


TCAG 


- 1/.? ; 




Oe It 

-05 A 


-D2.0 


-j#.0 


SKA 


79^ 


115 J 


A- A 

0.0 




TRA , 


0.6 




0.0 
Ji8,4 


A A 

0.0 




AOOHS 


51.il 


A3 


21.6 


49.2 




93-8 


92.1 


faO./ 


/O./ 




■row 




53;3 


-23.1 


-69.9 


'l0.3 


ABii 
ASii " 


-44.1 




-29.6 


-173.0 


.36.5 


-77.8 


16.7 ■ 


0.0 


-2(5.0 


27.8 


I 


9U 


-97.5 


-60.0 


-21.7 


-16.3; 


PI ' ! 


334.9 


528.6 


1605.9 


120.3 


2^1.9 


iii - 


1.0 


55.6 


1.0- 


0.0 


i;9 


Total 


693.2" 


636.4 


1409.6 


-305.8 


2$63.2 



MAGNITUDE OF CHANGE i «f DIRECTION BY GROUP* 

Percentage (Snapshot) 
Variable Grp 1 



• .Average 3&;48 74.19 -16.09 155-96 

(percentage of change) . _ 

Rank 3 if 2 5 1 
(l = highest} 



as loo.i 101.^ Q.i MS 

RA 17.9- 912.0 7.1 247.6 173.1 

MA 27,8 78.I 1%5 0.0 11.8 

I/E . 28.1 73.3- 93.7 15.3 19-3 

BRA 1.7 19.1 ' 10.5 -26.2 62.5 

PD -30.1 -1^3.2 -106.3 0.0 9.3 

iii. -6.0 -93.5 -17.6 62.1 \y& 

TTQ 27.2 33.6 -88.9 0.0 86.4 

si 59.9 93.5 68.4 44.5 35.7 

sii. 67.4 96.8 60.6' -21*6.8 19.4 

BD 0.0 98.5 98.7 0.0 -5.6 

JU-, ■ -83.1 24.5 136.Q-- 26J_ 61.2; 

Total. 211.4 1234.2 504.1 <123.3 60;.2 , 

.Average ' 17.62 102,85 42.01 10.28 50.27 
(percentage of change) 

Rank 4 1 3 5 2 
' (1 = highest) 
5 Average of the tvo ranks: 

3.5' -2.5 2.5 5.0 1.5 



"•*-Q" wv " * r | 1 ■" 

If the teachers increased or decreased as directed by the correlation with achievement (table. 6), it is 
listed as a positive change (+). If the teachers increased or decreased opposite the direction recommended 
by the correlation with aiivement, it 'is listed as a negative change. 



as shown i>i tabic 8. From this a stebiiizec picture emerges, and the average - 
of the FHi and Snapshot ranks confirms the. average of the two ranks given in 
table ?. For this study, then, the average rank from table 8 will 
be the ranking of reference. 

For future studies, two avenues for ranking training groups based on \ 
outcome variables such as these might be recommended: One is to increase . 
the alpha level to --:10. . This v/ould be sensitive to more of the smaller % ., 
.. changes made by teachers. The other is to use a criterion referenced measure 
of change v/hich Would not be influenced by different group sizes, starting 
points or opportunities to change. If the study has variables more equivalent in 
variance and groups of more equal size, an analysis as done here should be 
satisfactory. 
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table 8 



Percentage (Snapshot) 

Variable jrj 1 Grp 2 Grp 3 Grp if Grp 5 Variable Grp 1 Grp 2 GrpJ flrp j G r p3 

AAS - 2 3 3 "4 
TIE 4 3 2 $ 



* • 3 5 1 

TACQ 1 | ' 2 5 

TCUDS 5 - if 2 i 

S8 ^ 5 5 1 

TTOS 13^5 

TC 2 3 5 ^ 

TCAG 1 3 5 If 

S8A i- 3 2 5 

TRA if 2 *f h 

mm i.l 5 3 

TM. 2 3 5 J f 

1 2 J 5 



1 

1 


AO 


5 
C 


h 


1 
1 


5 


3 


1 


RA 


if 


1 


5 


2 


3 


2 


1 


3 


2 


l 


5 


if 


3 


l]l 


3 


2 


l 


5 


if 


3 


BRA 


■ if 


2 


3 


5 


1 


2 


PD 


3 


5 


if 


2 


1 


2 


WA 


3 


5 


k 


1 


2 


1 


TTQ . 


3 


'2 


5 


if 


1 


2 


SI 


3 


1 


2 


If 


5 


1 


su 


2 


1 


3 


5 . 


if 


1 


BD 


3.5 


2 


•1 


3.5 


5 


2 


m 




if 


—1 — 




-f- 


1 


Total: 


f 


% 


35 




35 


3 














2 

'1 


' Average 
Hank: 




1.5 


1.5 


5 


3 



* 

1 = highest, 5 
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/IBS if l 3 5 

ASS if 2 3 5 

I 15^32 

PI 3 2 1 5 if ... 

NI 3 _ 1 3 ; 5 -3— Average of the two ranks:* 

Total: 51 $ 69 ?if 3? 

Average 

' ilc: 2 3 if • 5 1 3.00 2.25 2.75 5.00 2.00 
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TRAINER eiTATiON OF OBSERVATION VARIABIES 

It is reasonable to consider that teachers would change their behaviors 
not necessarily because of the manner in which they were trained nor because 
of the style of their trainer, but simply because they were told to do so. 
The more frequently the trainer mentioned or cited a particular variable, 
the more likely that the teacher would be aware of that interaction at the 
time of the post observations. This could be because the teacher had been 
conditioned to think about the variables or because the teacher, by virtue 
of the number of citations, knew that that variable was important to the 
trainer and strived to please her; In either case, it could be expected that 
there would be a high correlation between the number of times a trainer men- 
tioned a. specific observation variable, and the magnitude of change in that 
variable effected by teachers in their classrooms. 

For this analysis the two observers tallied each time the trainer made 
a specific reference to an observation variable, as shown in table 9. Th> 
tally was not to be made for general discussion of the variable, only the 
use of the same words as stated in the variable. There was some latitude 
in this criterion, allowing, for example, a tally for the variable, Teacher 
Praises or Supports, when, the trainer simply said, "praise." But an example 
such as, "intercom," was not allowable for a tally under the variable, In^ • 
trusion. Obviously^ the problem was one of defining legitimate tallies. 
The key to the decision was whether or not the trainer seemed to be citing 
a specific behavior which would be measured on the post observation. 

The interrater correlation on a one hour observation of the tape was 
r = .97 for 28 of the 29 varisibles. On that observation * however, one obser- 
ver failed to tally references to the variable, Intrusion. For all 29 vari- 
ables,, the interrater correlation was r = .69- The observer had picked tip 
Intrusion prior to and after the correlated sample. Several "different 



table 9 



mABJER CITATION OF OBSERVATION VARIABLES 



Variables Acronym 

INSTRUCTION 

1. All Academic Statements . AAS 

2. Teacher Instructs/Explains ; Instruction/ 

Explanation (interactive instruction, TIE 

direct instruction) I/E 

3. Teacher Asks Direct Questions TADQ 
if. Teacher Asks Clarifying .Questions TACQ 

5. Teacher Calls Upon Different Students TCUDS 

6. Student Responds 38 

7. Reading Silently ' Rs 

8. Stud_ents_Read Aloud (reading aloud) SRA 

9. Teacher Reads Aloud (reading aloud) TELA 
^0 Reading Aloud (mean of 8 8c 9 above) RA 

10. Making Assignments MA^ 

11. Practice Drill : _ : 

12. Written Assignments WA 

13. Test Taking/Quiz TT Q 

CORRECTIVE FEEDBACK 

l*f. Teacher Praises or Supports (praise) TPOS 

15. Teacher Corrects ... 

16. Teacher Corrects and Guides (probing 

and guiding) WAG 

17. Discussion/Review Assignments BSA 

CLASSROOM MANAGEMENT 

18. All Organizing or-'Managing Statements AOOMS 

19. Teacher Working Alone ™ A 

20. Teacher Monitoring Written Work 

(monitoring) TEfW 
21i Intrusion 

22. Positive Interactions (interactions) PI 

25. Negative Interactions NI 

2*L Student Uninvolved SU 

25. Classroom Management CM 

BEHA^IQR^jAMS£mffi 

26. Behavior Statements ABS 

27. Social Statements _ r ASS 

28. Social Interaction (socializing) SI 

29. Being Disciplined (disciplining^ BP 

Total: 
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19 


4 


5 


lft 


3ft 


70 


22 


fto 


ftl 


8 


19 


17 


7 


3 


7 


2ft 


2ft 


6 




3 


ft 


2 


2 


8 


8 


9 


6 


6 


2 


7 


16 


10 


7 


9 


30 


28 


19 


2ft 


32 


22 


26 


13 


25 


29 


26 


27 


15 


2ft 


3Q 


Q 
7 




Q 


q 


Q 


8 


12 


6 


1 


12 


9 


21 


1ft 


5 


13 


9 


19 


1ft 


15. 


16. 


33 


36 


28 


16 


20 


11 






Q 


-r- 


19 


19 


17 


19 


6 


3 


13- 


6 


8 


6 


37 


33 


20 


19 


26 


13 


8 


2 


ft 


5 


7 


12 


5 


6 


10 


16 


12 


6 


9 


ft 


19 


28 


9 


23 


10' 


2 


11. 


ft 


7 


2 


1 


5 


5 


l 


0 




16 


16 


6 


21 


12 


26 


13 


10 


12 


if 


8 


6 


3 


i 


7 


8 


6 


8 


9 


2 


2 


ft 


7 


3 



359 53ft 317 309 335* 



*For one half of one workshop for Group 5 the tape recorder was accidentally 
not recording. The total number of references would more accurately- 
approximate 369 • 
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explanations arc plausible * but the point is -that the. observers should be 
trained or conditioned not to fail to recognize any observation variable; 



Given the high ihterrater reliability oh most of the variables ^ _ the 
results are probably fairly accurate. Other spot checks on the tallies * 
by th? researcher indicated accuracy. The t'.vo observers each listened to 
different halves of each trainer's workshops, and these were alternated so 
the observer tallies are evenly applied to. each trainer. 

An examination of total number of references to the observation variables 
by the trainers (see table 10) provides no consistent ranking with the ranking 



of teachers' change in their classrooms, except for Group *f which was last in 
both. Group 2 had the greatest number of trainer citations, and * was the only 
group with significant Snapshot changes ('table *f). Note on the last work- 
shop, Group 2 mentioned 19 different variables, more than all the others, and 
made repeated references, totaling 96 over all" the variables. Looking at 
this table alone, it would appear that the strongest training programs jjiay be 
those x^hich have an academic approach with an emphasis on the behaviors to 
be changed. However, a Tukey test from a one-way ANOVA of trainer, citation 

table 10* 



Rank Group 




I 


II 


V/orkshop 
III 


IV 


V 


Total 


h 


l 


No." 
Sum 


23 

70 


22 
92 


17 
71 


21 
73 


15 
53 


359 


2 


2 


No. 

Sum 


26 
113 


2? 

118; 


2k 
172 


10 
35 


19 

95 


53^ 


3 


3. 


No. 

Sum 


2% 
119 


21 
38 


• 21 
71 


13 
±3 


l*f 


31? 


3 


k 


No. 

Sum 


26 
96 


23 
96 


20 

h2 


l*f 
63 


7 

18 


399 


l 


3' 


No. 

Sum 


20 
88 


2S. 
123 


9(18) 18 
3'+(68) 57 


11 
31 


335(359) 




*Hank is based upon 


table 


8 , the aver 




magnitude 


of change. 



1V Number is the number of different variables mentioned. 
jSum is the total number of .citations £br all : variables. 
* Figures for Group 5 are adjusted for the missing tape for half 
of the third workshop; - 



combined with magnitude of change by groopj showed rid significant difference 
between the training groups. ; * 

In looking for a relationship between the ranking of the magnitude of . 
change by group (table 8) and the ranking of the trainer citation (table 93- 
over each variable, only two variables had duplicate rankings: Teacher 
Reads Aloud (TRA) and All Behavior Statements (ABS) . This question of 
whether or not the number of times a variable was mentioned in training _ 
had an influence on how much the teachers changed that variable is 'examined 
by a two-way ANOVA which showed significant main effects between trainer 
citation and teacher change, (d.f = 1,248; F - '4.467; 'p. = .636). This sig- 
nificant difference means that the training experience did not translate 
into classroom behavior. On table 11, which gives the means for the five 
groups combined, arid graph 1, which illustrates the same for trainer citation 
by teacher change on each variable, no significant correlation is in evidence. 

The ANOVA test found that there was a significant 'interaction between' the 
variables and Whether they Were from the training or classroom situation, 
(d.f. = 30,248; F-1.794; p. = .009). This significant interaction, however, 
is a result of the large increases in some variables and decreases in others. 

Other • significant main effects were found between the variables,. (d.f. = 
30,248; F = 1.926; p. = .004). The variables each acted differently as can 
be seen in table 11. The variables on which teachers reduced their behavior 
generally fall at the top of the list, and those variables on which the 
teachers made the largest improvements are shown at the bottom. A Tukey 
test found that the only variable which operated significantly differently 
from the others was Positive Interactions (Pi)' at the bottom of the list. 
It was significantly different from the top sixteen variables on the list. 
On the graph those are the variables which form a circle c3.uster in the bot- 



AVERAGE TRATEER CITATION AHD TEACHER CHAK33 ffl EACH VARIABLE 



Variables 



Toachar Corrects and Guides (TCAG) 

Practice Drill (PD) 

Teacher Asks Direct Questions (TADQ) 

All Social Statements (ASS) 

All Behavior Statements (ABS) 

Students Respond (S3) 

Intrusions (I) 

Teacher Asks Clarifying Questions (TACQ) 
Student Uninvolved (SU) 

Teacher Calls Upon Different Students (TCUDS) 

Written Assignments (UA) 

Negative Interactions (NI^ 

Teacher Monitors Written Work ( TMWW ) 

Discuss/Review Assignments (BRA) 

Teacher Corrects (TC) 

Test Talcing/Quiz (TTQ) 

Teacher Praises or Supports (TPOS) 

Teacher Instructs/Explains (TIC) 

Being Disciplined (BD) 

All Organizing or Managing Statements (AOOMS) 

Classroom Management (CM) 

Making Assignments (MA) 

All Academic Statements (AAS) 

Social Interaction (SI) 

Reading Silently (RS) 

In struc tion/Expla na t i on ( I/E 5 

Teacher Working Alone (TWA) 

Student Reads Aloud (SRA) 

Reading Aloud (RA) 

Teacher Reads Aloud (TRA) 

Positive Interactions (PI) 



Average 


Average 


. _ 
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_ C.nanro . 


Aver 5 e : -t<. 


16.6 


-70.23 


-27.14 


7.8 


-54.06 


-23^13 


11.2 


-30.22 


-9-51 
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-2.28 
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12. Co 


8.46 


8.0 


10.03 


7.2 


13.52 


10.36 




11.82 


10.61 




11.66 


13.13 


26.6 


.02 


■ 13.31 


m.k 


=6.22 


17.60 


3.6 


38.32 


20.96 


27.0 


I7.62 


22.31 


14.6 


33-03 


23 r .84 


11.0 


. ' 51.64 


31.32 


9-4 


• 53-54 


31.4? 


7.6 


60. 4a 


34.00 


• 9.8 


66. co 


37.90 


41 


45.94 


43.67 


6. if 


83.80 


43.12 


26.6 


106 i 02 


66.31 


24.4 


. 271.54 - 


147.97 


25.0 


442.70 


232.85 


17.8 


566.32- 


292.06 




Grand Mean: 


33.08 




S.D. : 


69.453 



torn left-hand portion of the graph. One important indication of table II is 
that the act' of teaching is an integrated set of behaviors, and to modify any 
one member of thai; set will effect tho other members. To increase.' some var- 
iables will decrease others. . .. r - 
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SCATTERGRAM OF VARIABLES BY TEACHER CHANGE AND TRAINER CITATION 
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FLANDERS INTERACTION ANALYSIS 



ERIC 



The agasurofflsnt and analysis of teacher -student classroom interactions 
desired by Flanders has been submitted as a sajor tool- by which teachers . 
ca:; examine and understand their own behaviors , ; and if desired, modify their 
behaviors accordingly. The Flanders system provides a measure of such facets 
as direct vs. indirect instruction, teacher vs. student talk, interaction 
vs. monologue j and student-initiated discussion vs. student response. In 
addition, specific teacher behaviors such as praising, questioning, lecturiHg - ^ 
and reprimanding are measured. 

•This tool, applied to a situation of a trainer instructing teachers 
should be most useful for trainers since they are in the profession of knowing 
how to best instruct others. In this study, the Flanders analysis should 
help portray what types of trainer-teacher interactions provide the best 
model for encouragrbig -teacher change. In addition,, insights may be gained 
into the types of changes made by teachers in the different training groups.- • 

The Flanders analysis was conducted by two observers who learned the 
technique with the help Of a programmed instruction book by William J. 
Kryspin and John F. Feldhusen entitled, Analyzing Ve rbal Classroom Interactions. 
After reading the book the observers held two practice sessions of about 
2/ 2 hours each,, at the end of which their interrater correlation using all 
ten categories Was r = .82. 

The design called for each observer to take a 1Q# sample of the workshop 
tapes. This consisted of one minute of observation for each ten minutes of 
training time. The start points for the. one minute were determined randomly 
from the first ten minutes and assigned using the built-in. counter in each 
tape recorder. . • 

r!ST m mm 
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2? ; . 
Tife counter is calibrated to the revolutions of one spindle of the tapes. 

— . a 

Of course, when this tape is quite thick on that (spindle , the revolutions are 
much slower than when the tape is almost completed. For that reason * the . 
first tape recorder was hand tabulated, noting the counter number at the end 
of each ten minutes of tape time. The second tape recorder had a different 
count frequency, and these were matched at the beginning and middle of the tape 
with the first recorder^ with several trials and averaged about 3*6 counts 
to the first recorder's one count. The second observer was instructed to, 
multiply the count of his' start points by 3«6. When the observations were 
completed, it was obvious thai? £he adjustment had not been accurate since 
the second observer recorded only three observations for every five of the 
first observer. This resulted in a sample of about 16$ of the time. 

During the minute observation the observers recorded one communication 
or statement every three seconds, making twenty statements per observation 
minute. Using Flanders 1 method of analysis (see charts 1-5) i' each statement 
is paired with the statement following iti The first statement is recorded 
by row and the successive statement in the appropriate column of that row. 
With the sampling the last statement does not have a succeeding statement. 
■Gn the chart, those are recorded as identical pairs (1-1^ 8-8, as that ' 

tally' was desirable for the most complete row totals. In the analysis of 
interaction vs. identical pairs, the last statements have been deleted from 
the totals. • 

In looking for the relationships mentioned' earlier- between trainer 'be- 
havior 'and teacher classroom behavior; on praising and question/answer duads, 

_s _< 

some interesting findings come from the Flanders analysis • for praising ; • 

; •.. «... ... ) 

the percentages for each group were: Group 1 - 1$; Group 2 - 3-6$; 

Group 3 - 8.9$; Group *f - 1.6$ and Group 5 - 0.2$. The outstanding trainer 
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chart 1 



Flanders 1 Interaction Analysis:- Group 1* 

Successive Statement 



Statement 



Accepts feeling 



Praises or encourages 



Accepts or uses student 
ideas 

Asks questions" 

Explaining or informing 

Gives directions 

Scolding/reprimanding or 
defending authority 



Student talk: expected 
or predictable response 

Student talk:- initiated 
response 

No talk/all: talk, transi 
"tion between students 







2 




i 




6 ! 




8 


9 


10 


1 






U.J. 






• " 






ri-1 














no 








y« ( 




± 

2. 


hi 




i -ri 

-Lm\J 












0 ^ 


0 T 


4 








3.6 


0.8 


6.1 




2.0 


0.8 


0.7 


5 








1> 


26.6 


0.1 




Oil, 


2.9 


0.9 


6 








0.1 


9.1 


0.2 






0.1 




g 






















8 


0.2 




0.1 


0.3 


0.3 


0.1 




2.if 


1.5 


0.2 


£ 


O.T" 




0.5 


1.6 


2.if 








$8.0 


0.9 


10 







0.1 


0.5 


1.1 






0.6- 




2.1 



Total 
0.7 

±»± 
±.8 
8.0 
32.5 
0.5 
0.0 
-5.0 
Mk7 
5.7 



% Trainer Talk (rows 1-7 3 

% Teacher Talk (rows 8-9) ^9.7# 

% Mo Talk/All talk (row 10) 5-7$ 



% Indirect 
% Direct 



; (rows 1-4) 25. 9# 
(rows 5-7) 7^.3# 



% Interaction 26.995. 
% Identical Pairs .733 



♦Figures are reported in percentages.; % ji .» 
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chart 2 




Statement 
Accepts feeling 

J. Praises or encourages 

, • j_ ; 

>. Accepts or uses student 

ideas 
Ym Asks questions 

5. Explaining or informing 

i. Gives directions 



i ' 

Y. 
). 



Scolding/f eprimahding or 
defending authority- 



Student talk: e3 
or predictable response 

Student talk: initiated 
response 

No talk/all talk, transi- 
tion between students 

'% Trainer Talk (rows 1-7) 
% Teacher Talk (rows 8-9) 



Flanders 1 Interaction Analysis: Qapoup' 2* 

Successive Statement 



( 


i 


2 


3 




5 


6 


7 










6.1 


Oil 


Oil 


















Oil 


0i8 


Oil 


0.3 


0.8 


o'.r 


f 


0.1 


l.i 


0.3 








0*8 




0.2 


r 






0.1 


6»i 


\ 


0.1 






1.0 


0.3 






: 1.3 


0.2- 


0.6 


5 




0.4 


0.1 


1.5 


46.1 


6.6 




0.2 


2.5 


2.6 s 


' i 










0.6 


0.7 






o.i 


0.1 


7 






















a 


0.1 


0.3 




0.2 


0.1 


0.1 




0.8 


1;2 


b.i 


9 


•j 


1.8 


0.2 


0.4 


2.6 








18.9 


1.3 






0.4 




0.3 


2.2 


0.1 




0.4 


1.5 


3.0 



64.03 
28. e$ 



# No Talk/All Talk (row 10) 8.0# 
♦Figures are reported in percentages, n = 1708 



% Indirect Training (rows. 1-4) 
% Birect Training (rows 5-7) 

§ Interaction 2$M 
% Identical Pairs ?2.C$ 



ffotal 
0.2 

3.6 

i.i 
3.6 
54.o 

1.5 
0.0 
2.8 

25.3 
8.0 



13.2i 
86.7^ 
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chart -3 



Statement % \ 

1. Accepts feeling 

\ 

2. Praises or encourages 



3. Accepts or uses student 
ideas 

4. Asks questions 

3 • Explaining or informing 

6. Gives directions 

7i Scolding/reprimanding or 
defending authority 

8; * Student talk: expected 
or predictable response 

9; Student : talk: initiated 
response 

0. No talk/all talk, transi- 
tion between students 

% Trainer Talk ; (rows 1-7) 
% Teacher Talk (fows 8-9) 



Flanders 1 Interaction Analysis: Group 3* 

Successive Statement 





1 




3 


if 


5 


6 


7 


8 


9 ' 


10 


' 1 


Oil 




Oil 


0.1 


Oil 








Oil 




2 






0.1 


0.1 










0.4 


Oil 


1 






0.5 


0.1 






c 




0.1 


0.2 


i 




0.1 




2.0 








1.0 


0.1 


0*4 


5 




0.1 




liO 


ko.o 


0.2 




' 0.1 


1 ; .3 


1.9 












Oil 


0.5 










7 






















8, 




0.1 




0.2 


0.2 






1.7 


0.5 


0.3 


9 


0.1 


0.6 


0.3 


0.6 


1.7 


0.1 


I 




26.6 


2.0 


2£L 


0.2 




0.1 


0.3 


1.8 


6.4 




0.4 


2.1 


8.8 



Total 
0.4 

0.9 
0.9 
• 4.1 
44.6. 
0.6- 
6.6; 

2.9'j 
31.8 | 

l4.o 



51.3$ 
34.7# 

% No Talk/All Talk (row 10) l4.0# 



% Indirect Training (rows 1-4) 12 A 
% Direct Training (rows 5-7) 8?.? 



% Interaction 20. 7# 

% Identical Pairs 79. 3& 1 



♦Figures are reported in percentages, n = 1521 
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chart 4 

* 

Flanders' Interaction Analysis: Group *f* 
v S uccessive Statement 



\ Statement 
t. Accepts feeling 

, " * - — 

i. Praises or encourages 

\ 

, i 

5* Accepts or uses student 
ideas ~ ° 

l-w Asks questions ' 

>. Explaining or informing 

>• Gives directions 

? , . Scolding/reprimanding or 
defending authority 

Student talk? expected or 
predictable response 

). Student talk: initiated 
response 

). No talk/all taiic, transition 
between students 





1 






< k 








a 






X 


n i 




D 1 


6-i 














o 






n i 


0 1 


6 8 








0.3 


0.2 






U» -L 


J.* J. 




\J mC 








b-2 

— 7* ' 


0.1 










1.7 


0.2 






1.6 


0.1 


1.2 


5 




0.2 


0.1 


1.3 


37.4 


0=2 




0.2 


1.7 


2.0 


6 










0.2 


0.2 










.; 7 






















8 




0.1 


0.1 


0.1 


0.3 






2.8 


1.2 


"0.1 


g 


0.1 


0.9 


0.4 


0.6 


1.5 


0.1 






32.6 


1*2 


j 


Q.l 

I 


0.2 




0.5 


1.6 






0.5 


2.0 


2.3 



Total 
0.2 

1.6 

1.6 

4.8 

43.0 

0.3 

0.0 

4.4 

36.7 
7.2 



% Trainer Talk (rows 1-7) 51. 6$ 
% Teacher Talk (rows 8-9) 4l.2# 
% No talk/All Talk (row 10) 7.2# 



% Indirect Training (rows 1-4) l6.0# 

% Direct Training (rows 5-7) 84.0 

% Interaction 21. 75^ 

% Identical Pairs 78.3$ 



♦Figures are reported in percentages, n = 1236 
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Flanders 1 Interactic&i Analysis: Group 5* 

Successive Statement 



* 

t Statement 


i 


z 




it 


5 




7 


" 8 


9 1 


10 ; 


Total 


V. Accepts feeling 


1 










0.1 












0.1 


Si Praises or entourages 


2 




0.3 






Oil 








0.5 


0.1 


0.9 


5. Accepts or Used student ideas 


3 


















0.2 




6.2 


%. Asks questions 


k 




0.1 




0.9 


0.1 




Oil 


r.i.6 


0.3 


0.6 


3.6 


5. Explaining or informing 


5 








0.6 


22.9 


Oil 






1.3 


1.1 


26.0 


5. Gives directions 


6 










0.1 


Oi*f 








0.2 


0.8 


p. .^colding/reprimanding or^ 
defending authority 

3. Student talk: expected or 
. predictable response 

3. Student talk: initiated 
response 

D. No talk/all talk, transition 
between students 


1 














0.1 


0.1 






o.i 


1 




0i2 


Oil 


0.3 


0.3 






2.6 


1.0 


0.3 


4.8 


i 




. 0.6 


0.1 


1.3 


1.1 






o.i 




2.7 


50.6 


10 








6.4 


1.7 






0.3 


2.9 


7.5 


12.9 



% Trainer Talk (rows 1-7) 51. 7% % Indirect Training (rows l-*f) 15.235 

% Teacher Talk (rows 8-9) _ 55^ # Direct Training (rows 5-7) 8*f„8# 

% No Talk/All Talk (row 10) 12.9$ 

- - % Interaction 21.3$ . 

% Identical Pairs 78.T& 



♦Figures are reported in percentages, n = 1598 
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* ■ 

for jiraisiiig v/ati Group 2, which did nst hsre the first ranking* but did 
Irivo the .significant changes .in the classroca Snapshot. Group 1 had been 
;the only group of teachers to significantly increase .their praising of 
Students, but this did not translate from their trainer's praising. 

For questioning behavior the group percentages were: Group 1 ~ 8.0$; 
Group 2 - '$.6%; Group 3 - k.1%; Group k - k/ifo and Group 5 - She 
interesting point to note here is that Group 1 teachers . were the only ones (> ■ 
who did not decrease significantly the variables of Teacher Asks Direct 
Questions and Students Respond. The Group 1 trainer had been the trainer to 
use the most questions. • 

The S tailings model for training is designed for small groups- where 
teachers are encouraged to bring their experiences- to the group for suggested 
solutions. This is a situation similar to Flanders* indirect instruction. 
If. the teachers transferred to their classrooms their experiences from train- 
ing, those groups with a greater proportion of indirect instruction would be 
expected to have more ' praising and supporting and positive interactions than 
the teachers in groups with direct training approaches. An examination of 
table 12 supports this relationship!. The Group 1 trainer had the most in- 
direct approach, and her teachers were the ones who had increased their 
praising and supporting of students. The. link between indirect training and 
teacher-student positive interactions would. also hold for Group 1, but fails 
for Group 3 which also had positive interactions, but the most direct trainer 
style. 

It could be postulated that trainers v:ho do not dominate the discussions 
would be most likely to induce their teachers to want to change thei^; - ■ 

i 

classroom interactions; This appears to be supported by the low percentage 
of trainer talk (31.72$) in Group 5i which had the highest ranking of teacher- 
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3F i'lffi FIuC 








Group 1 


Group i 


Group 5 


Group 'r 


Group 5 


25.9/o* 
7^.1 


86.7 


: 12.2/3° 

87.8 


84.b 


84.8 


Mf.5- 
^9-7 
5.7 


&i.O* 
28.0 
8.0 


51.3 
3^.7 
l*f.O 


51.6 
7,2 


31.7° 

55.^ 

12.9 


26.9 . 
73.1 


29-0* 
71.0 


20.7° 
79.3 


21;? 
78.3 


21.3 
78.7 
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fa indirect draining 
^ Direct Training 

% Trainer Talk 
% Teacher Talk 
& lib Talk/All Talk 

% Interaction 
% Identical Pairs 

*Group with the greatest percentage. 
°Group with the least percentage. 

change. However, the importance of teacher talk vs. trainer talk is not" 
supported by the remaining groups in which Group 2, ranked second, kas\the 
highest proportion of trainer talk, and Group 4, ranked last, falls in the 
middle of the .proportions. 

It may be that teachers- from training groups with more interaction 
modified their classroom behaviors to have more teacher questioning and 
student responding interactions. This would be best represented by Group 1 
which did not decrease interactions on the so variables. Table 12 indicates, 
however , that no such relationship can be established. 

Group 5, which had the highest ranking is different from the other groups 
in the Flanders analysis in the categories, Accepts feelings, and 

Accepts or Uses Student Ideas, in which Group 5 has the lowest percentage. 
A possible explanation is that the trainer did not want to accept or reinforce 
teachers 1 current behaviors; instead she wanted- to encourage them to adopt 
the behaviors taught by the program;" ; : - 

•Group 2, iii which the teachers made significant change in the Snapshot 
variables, presents a model distinguished in three ways: Group 2 had the 

e:sr immMm , is 
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greatest amount cf trainer talk — two- thirds of the statements. In 
addition this group had the greatest hur.ccr of interactions and praise. 

The Flanders analysis appears to be very useful for trainers to examine 
thsir owr^diyiduai styles of training. It is not as strong in establishing 
that the dimensions that it measures are critical in effecting teacher change. . 
As a measurement tool, it identified an outstanding group on a few- items, 
but could not discriminate among the remaining groups. 

The adaptation of the classroom observation technique to an observation 
of taped teacher training was hot difficult. There was a feeling of inapprb- 
priateness of separating categories 8 and 9 (Predicted Response and Unsolicited 
Response). In most situations the teachers were asked to give ' descriptions 
of their classroom situations : . which could be in either category. 

The other major question of misfit was the emphasis on interaction. 
The Flanders analysis was designed for the cuick-teacher sks question then 
student respondsr-exchanges of the classroom.. For adults , each speaker v whether 
trainer or teacher usually talks for a prolonged period. That is why so 
many of the tallies on the charts fall in cells (5-5) and (9-9)- The tallies 
in the other cells do, however, shed valuable information about the trainer's 
style and would suggest that this observation system is valuable , but that 
different expectations and analyses of the data should be made for teachers 
in training as opposed to students in a classroom.- ; ■ - 
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B. 0. SMITH'S ANALYSIS OF THE LOGIC OF TEACHING 

In the 1950's B. 0. Smith studied classroom discourse by using tape 
recordings. Transcripts of the tapes formed the basis for identifying 
episodes or completed verbal transactions between two or more speakers* 
As SW&th describes it, ,T We can sense a forward surge in the flow of talk, 
propelled by the familiar rising tones of a question or declaration. A 
spate of responding talk is thus launched, - runs on, then tapers off. 11 * 
(Smith, p. 3.3) Within this description it can be seen that an episode has 
three parts: an. opening phase, a sustaining phase, and a terminating phase. ' 
Smith concentrated on the entry statement which initiated the opening phase 
of an episode. The entry, "always contains a verbal move which evokes at 
least one, but more often a series of related verbal exchanges. It is always 
a self-initiating move on the part of the person who makes it and is followed 
by responding remarks. 11 (Smith, pp. 5.1-5.2) 

The entry is usually a question and thus can be analyzed for the type 
of logic or symbolic operations being required of students, or in this case* 
of teachers in training. The category of logic of the entry was determined 
by the type of response it demanded. Smith used an empirical procedure for 
defining the categories based upon the nature of the entries themselves. 

The categories which fit the empirical approach and which were still common 
in" discourse on logic were: Definition, Designation, Classification, Con- 
ditional Inference: and Substituting^ Other categories — Explanation, 
Evaluation, and Compare/Contrast -- • thougli not established in studies of 
logic, demand specific forms of logical thinking. The remaining categories,' 
Describing, Stating and Reporting * were further categories required' by the 
empirical approach of the study in order to classify all entries, as was the 
category > of instructor directions, Directing and Managing Statements i 

a 
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These categories can provide insights to the type of thought and analyses 
teachers were being asked to rake of their teaching situations. Certain 
questions or entries require teachers to more deeply examine their teaching 
behaviors, and thus might be more likely to alter those behaviors. 

The procedures used basically followed those recommended by Smith; 
however, a transcript was not prepared because of time and cost considerations ^ 
and because it appeared to be necessary only to write the entry phrases of 
the trainers. The entry phrases proved to be the major problem in adapting 
the classroom model to a teacher training situation: In teacher training, 
many of the episodes were initiated by the teachers , and the trainer would 
speak only during the terminating phase of the episode; The decision was 
made to only code the trainer's entry statements. As a result, the teacher- 
initiated episodes were not used. The major point to be made is that teachers 
initiated much of their own training, which is not as true of students in a 
classroom. 

Five observers each listened to one workshop of each of the five trainers. 
The observers wrote down each entry question or statement of the trainers. 
One rule required that a statement could be counted as an entry only if it 
asked for and received a response from teachers. After the entries were 
typed, they were color-doded by worfcshop and by trainer, and cut out to have 
only one entry on each slip of paper. The approximately 700 slips , lying in 
one pile, were alternately divided into two sets. Four observers formed two 
teams^and each team analyzed all of the entries ih one of the sets and ^i^laced 

_______ ■ .Vr ** , v»" f »" yV* % 

them in the appropriate category as shown in chart 6. ' - 

Using the number of entries by category , except Substituting, and by 
trainer, (n- = 6l5^ the correlation between teams was r = .82. For Substituting 
there wsre no tallies . Even with the high correlation, there was a problem 
in the Stating category, for which one team had assigned 102 entries compared 
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chart o 



CATEGORIES OF LOGIC 



Cz±ti<?nr±as of 3/ 0. 



J_rni±h* 



I; DSFBiiNG - provide the meaning. of a 
term. Concern is with how words or 
other symbols refer to objects; 

II. DESCRIBING - tell about something or 
represent it by words. 

III. DESIGNATING ~ identify something 

by name. Something is. described and 
the name used to refer to it is 
asked for. 

IV. STATING ~ state something; simply 
naming or describing is seldom 
satisfactory. 

; 

V; REPORTING - report on a document, 
or give a summary or review 

VI. SUBSTITUTING - perform a symbolic 
operation, usually of a mathematical 
nature. ;; r . 

VII. VALUATING - estimate the worth, 
dependability, desirability of 
something. * 

VIII. OPINING ' - express a belief, usually 
based on little or no evidence. 



DC. CLASSIFYING *- place a given instance 
into the class (type, sort, group , 
set, kind) to which it belongs. «■ 

X. COMPARING AND CONTRASTING - compare 
two things noting their similarities 
. and differences. 

Xl/ CONDITIONAL INFERRING - provide a 
consequent', given an antecedent or 
condition in the entry statement;. 



XII. EXPLAINING - explain a particular 
event.br give an antecedent, when 
a particular consequent is provided. 



XIII. DIRECTING AND MANAGING _ CLASSROOM - 
trainer statements designed to keep 
the class activities moving; 



Working Definitions 
Used w ith Categrnrig* 



t ■ deals with definitions. 



II. answers are to be yes or 
no* or a specific answer, 
without any explanation. 

Ill . given the category , 

identify the items that 
fail in that category. 

IV. answers must give an 
explanation; may answer 
a "what" question, may 
begin v/ith yes or no. 

V. summarizing 
VI. mathematical operations 



"VII. render a judgement or 
evaluation that is 
professionally based. 

VIII. give an opinion^answers 
questions like Mhiat do 
you think? 11 "How. dcTyou 
feel about ...?" 

IX. classify | given an item, 
identify the category to 
which it belongs. 

X. compare or contrast 



XI. 



XII. 



XIH. 



use inferential thinking; 
entries contain an 
antecedent, may use the 
word^ ,9 ifi" » 

responds to a "how" or 
n why ,f question; gives an 
explanation as to why __. 
something occurred. More 
explanatory than STATING. 

gives instructions of what 
to do. 



XIV. 



ERLC 



DEFAUI5! - legitimate or , 

illegitimate entries which 

^ire^ambi^uous . 



♦Smithy ppi 5*1 to 5*l8 
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to the other team's 50; Because distinction among levels of trainers' 
entries was of greater importance and because ah effect of rater bias would- 
be lessened, the team with the fewer number assigned to Stating (meaning 
that finer distinctions were made) reanalyzed the 1CP entries. This then 
created an imbalance in the Describing category which were then also re-, 
analyzed by the one team. After the reanalyses, the two groups were ^ still 
correlated with r = .81. Major findings of this process were that (l) 
teams need to know more clearly to what degree their decisions are to be 
linguistically based, and (2) there is a team/rater with trainer interaction. 

As Smith found, the team decisions Were often based on linguistic clues} 
that is, the use of words such as "how" or "why" often provided the first 
indication of which category was appropriate for an entry. The categories 
as defined by Smith were supplemented with verbal clues and working definitions 
^by the teams on this research (chart 6). 

The most frequent categories of trainer entries were Describing, Stating 
and Explaining, and this was consistent across groups. (See table 13 .) 
Group 1 strongly distinguished itself from the other groups by the large i- 

proportion of opining entries, coupled with the low valuating proportion.. 

% _ ___ __ . __ 

This may explain why Group i teachers did not lose or decrease their frequencies 

on any of the observed positive variables: The effect of the trainer's 
constantly asking the teachers 1 opinions Sa. fact reinforced their current 
behaviors. Group i had the largest total of entry statements, which is 
reinforced by the Flanders' total number of questions, (chart 1, row 4). 

- Group 2 had the fewest total entry statements, indicating that the in- 
structor did not initiate as many episodes or talked more in monologue. 
Eefering to Flanders' finding (chart 3, cell 5-^) indicates that the Group 2 
trainer did use a lot of monologue, more than the other trainers. In 
the Flanders findings, this trainer had the greatest percentage of trainer 
talk and the greatest number of interactions. Shis trainer used Smith's 

50 
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table 13 



CATEGORIES. OF LOGIC OF TRAINERS' ENTRY STATEMENTS 



Categories 



Group I , Group 2 Group 3 Group 4 Group 5 • Average 

# % j %* # % I -ft- g gj . # _ 



I. DEFINING 



II. DESCRIBING 



III. DESIGNATING 



IV. STATING 



V. REPORTING 



VI. SUBSTITUTING 



VII. VALTJATING " 



VIII. OPINING 



DC. CLASSIFYING 



X. COMPARE/ 
CONTRAST 

XI. CONDITIONAL 
INFERRING 

XII. EXPLAINING 



XIII. DIRECTING AND 
MANAGING 
STATSffliTS 

DEFAULT/NOT' 
ASSIGNABLE 



5 2i& 

37 21.6 

10 5.8 

32 18.7 

3 f 1.8 
0 0.6 
5 2.9 

35 20.5 

2 1.2 

2 1.2 

4 2*3 
18 10.5 
18 10.5 

(6) 



7 ?.o# 
it^f 44.0 

8 8.0 
11 11.0 

0 0.0 

0 0.0 

4 4.0 
3 3.0 
0 0.0 

•i 1.0 

5 5.0 
10 10.0 

7 7.0 

(5) 



6 ° 4.3# 

40 28.4 

8 5.7 

25 17.7 

1 0.7 ' 
0. 0.0 
8 5.7 

15 10.6 
6' 4.3 

2 1.4 
1 0.7 

16 11.3 
13 9.2 

(63 



5 ' 4.5# 

32 28.6 

19 17.0 

12 10.7 

0 6.0 

0 0.0 

9 8.0 

7 6.3 
2 1.8 

0 0.0 

1 0.9 
16 14.3 

9 8.0 



1 0.63 

53 33.8 

14 8.9 

26 16.6 

1 ' 0.6 
0 0.0 
9 5.9 

18 11.5 

3 1.9 

2 1.3 

3 1.9 
17 16.8 
10 6.4 

m 



Total: 1?1 



100 



l4l 



112 



157 



3.9% 
31.3 

. 9-1 
14.9 
0.6 
0.6 

5.3 
10.4 

1.8 
1.0 
2.2 
11.4 
8.2 
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1 

Describing category more than the other trainers and used Opining the 
least i This trainer apparently wanted short answers based on the content 
being ^earned, without any loss of time discussing individual opinions • 

Group 3 had the largest proportion of classifying entries; although 
this was still small. In this situation ^ teachers are asked to identify 
the general category into which one or more examples belong. Group *F 
had the largest proportion of designating entries, asking teachers to give 
examples of a situation, or items in^a set. Group k also asked the largest 
proportions of valuating questions, asking teachers to judge situations • 
Group 5, as in the other analyses, is neither highest or. lowest in any 
category — excepting being lowest in Directing and Managing Statements. 

The expectation that asking teachers to think more carefully about their 
own experiences would make them more likely to .alter their teaching, proved 
nut to be true . An indication of the opposite — that to make teachers 
change, the trainers should rely more on Describing entries asking teachers 
to give short, specific answers — was indicated. 

The analysis of the logic of the trainers 1 entry statements provides an 
insight into what the trainer expected of the teachers, both in response 
mode and r in mental processing. This in turn provided partial explanations 
for the intervening processes leading the the teachers 1 changing their 
classroom behaviors . 



*f2 

CONTENT AfS'MiYSiS 

An analysis, of content could provide tile most useful data for a study 
of this kind. It would show what was really taught in the training groups, 

o - • . ' 

and it would show whiqh content areas were stressed by those trainers who 
proved to be more effective in causing their teachers to change. The corol- 
lary to that is that the analysis of content would show which content areas 
of training were the most useful parts of training. 

The form which catalogues the content areas to be tallied (see table l*f) 
was developed empirically based upon the. consultant's training of teachers. 
Recall that each Monday the trainer worked with the teachers in. a workshop 
while the other trainers observed. The next day, those trainers worked with 
their own workshop teachers and covered the same material as the consultant. 
The consultant's workshop was determined to be the best source of categories 
since workshop exchanges often go beyond printed curriculum materials. Thus 
the catalogue for the first workshop was based upon the first Monday workshop 
of the training program. The catalogue for the second workshop was again 
based upon the consultant's second workshop, using the initial form and sup- 
plementing it with additional items as they were introduced in training. 
The catalogue for each workshop was developed in this way, building upon the 
items given for prior workshops. 

The five observers used the forms to analyze the training tapes in se- 
quence, so each trainer's workshop was analyzed within the same catalogue 
restrictions. Observers added additional items to the* form when the content 
did not conform to the given catalogue items. The observers c tallied each of ^ 
the trainer's clauses or sentences under the appropriate item. / 

• - -- A 

The observers were not formally . trained, but they were made familiar 
with tire catalogue items. They reported no difficulties in knowing* where 



table ±*f 



2SAINER REFERENCE TO CONTENT CATEGORIES 

freq. = the number of clauses orsentences said by this trainer which 

fall in the given category, 
p. = this category *s proportion of .all the trainerJs statements. 







this category . 






Grp 


Grp 


Grp 


Grp 


(xrp 




X 


2 


3 


4 




freq. 


100 


n K 






2S5 




.o4 


• Up 






H 


rank 


3 


4 


5 


2 


' 1 


freq, 


185 


XX£ 


-Lr-L 


lit 
lit 


±52 




: 07 


• Up 


• UO 


BR 


.06 


rank 


2 


5 


1 




3 


freq. 


88 




ou 


Rq 
oy 


68 


P- 


.64 




•Op 


• Lrt 


.03 


rank 


1.5 


5 


3.5 


1.5 


3:.5 


freq. 


448 








366 


P* 


.18 


• vJO 






.13 


rank 


1 


if 




2.5 


2.5 


freq. 


l46 


<dOb 


3-? 




73 


P- 


.06 


.OO 






.03 


rank 


1.5 


1.-5 


if.5 


4.5 

• • ✓ 


3 


freq. 


197 


22b 


■LOy . 


OT 
71 


166 


P« 


.08 


.07 


.00 


nit 


.07 


rank 


1.5 


3»5 






3.5 


■ 

freq. 




117 


252 


215 


l72 


P»_ _ 


.06 


.03 


.12 


.09 


.07 


rank 


4 


5 


1 


2 


3 


freq. 


112 


222 


111 


172 


115 


P- 


.05 


.06 


.05 


.07 


.05 


rank 


4 


2 


4 


1 


4 


freq. 


123 


91 


55 


165 


144 


P-_ _ 


.05 


.03 


.03 


.07 


.06 


rank 


3 


4.5 


4.5 


1 


2 


freq. 


17 


54 


16 


6 


45 




.01 


.02 


,61 




.02 


rank 


3.5 


1.5 


3.5 


5 


1.5 


freq. 


36 


37 


49 


29 


24 


P* ' 


.01 


,01 


.02 


.01 


*01 


rank 


3^5. 


3-5 


i 


3.5 


3.5 



JIENCE 



A.l Background in teacher effectiveness 
research; general findings about edu- 
cation, student beha.vibr; this training. 

A.2 Trainer personal reactions .and obser- 
vations; "I" statements; discussion of 
today's workshop. 

A.3 Instructions of what to do next in the 
workshop* 

A.4 Setting the workshop climate; stroking; 
asking teachers , "What are you doing? 11 ; 
calling on teachers. 

A.5 Heview of prior workshops; report on 

homework and other assignments; overview 
of future workshops . 

A.6 Statement intended to alter teachers 1 
behavior; homework; what to do in their 
classy that week; training other teachers* 

A. 7 Observation forms: Snapshot, Five Minute 
Interaction (FME) , . observation process 
itself. 

A* 8 Sofiles; how : to interpret profiles; 
teacher.* s individual profile. 

A. 9 Workshop packets and materials. - 



A. 10 Doesn't conform to content mode: 
pleasant exchanges, jokes , etc. 

A. 11 Can't hear, discern. 



table l*f continued 



TRAINER REFERENCE TO CONTENT CATEGORIES: 





Srp 


Srp 


Grp 


Grp 


Grp 








1 


2 


-3- 


l: 


5 


B. SmSaESEES FOR TEACHING HEADING 


freq. 


13 


31 




6 


11 


B.l 


Claritv: crive clear instructions. 


Pi 


*01 


.01 


* 


* 


* 






rank 


1.5 


1.5 


- 


- • 


, - 






freq. 


5 


52 




0 


22 


B 2 


Varietv^ use a varietv of materials. 


"Do 


* 


.01 


* 


* 


.01 




activities. 


rank 


_ 


1.5 


— 


- 


1.5 






freqs 


66 


24 


30 


57 


32 


B 3 


Tnfin Vidua! differences: assess student 


Jr • 


.e3 


.01 


.01 


.02 






levels; use different techniques with 


rank 


i 


if 


4 


2 


k 




different student ability levels. 


freqs 


12 


81 


29 


4 


10 


B if 


Pprsnnal n ^.e i fifi'f'T'iio'h'i on • rnalce •in^'fcriictinri 


p. 


* 


.02 


.01 


* 


* 




appropriate to each child; individualize 


rank 


- 


•i 


2 


- 


- 




within groups . 


freq; 


18 


90 


25 




42 




WTinl-p fjrrmTi t nR"hT*iicf"i on . stria"! "1 kn^ouri 




.01 


.03 


.01 




.02 




instruction are recommended, not indi- 


rank 


3.5 


l 


3.5 


- 


2 




vidualized instructions 


freqw 


9 


8 


4' 


29 


26 


8-6 






* 


* 


* 


.01 


• .01 




mended • 


rank 


— 


- 




1.5 


1.5 






freq. 


9 






9 


8 


B.7 


Practice drill; oral drill are recommended. 




* 


* 


* 


* 


* 






rank 


— 


— 




— 


• — 






freq; 




12 


3 


12 


16 


B.8 


Discussion; review; students. presenting 


£>« 
jr • 


* 


* 


* 


* 


.01 




material. 


rank 


— 








1 






freq. 


24 


15 


15 


0 


0 


B.9 


Reading; focus on teaching readings 




.01 




.01 


* 


* 






rank 


1.5 




1.5 










freq. 


37 


46 


*f2 


37 
✓ < 


39 


B.10 Reading aloud; students and teacher 


"D. 


.01 


.01 


.02 


.01 


.02 




reading aloud, not silent reading are 


rank 


if 


4 


1.5 




1.5 




recommended. 




freq. 


1, 

4- 


5 


7 


0 


i: 


B.ll Vocabulary; teaching vocabulary, ; 




* 


* 


* 




♦ 






rank 
















freq. 


84 


46 


6 


118 


15 


~B.12 Teaching reading in content areas - 


P- 


.03 


.01 


* 


.05 


.01 




science, mathematics ~, etc. 


rank 


2 


3.5 


5 


i 


3.5 






freq. 


8 


37 


0 


95 


- 6 


B.13 Teaching students to fellow directions, 


Pi 


* 


.01 




.04 






use Dobks , charts, graphs. 


rank 




c 




1 












of, 




"2 









9 

ERIC 



table l*f continued 



TRAINER REFERENCE TO CONTENT CATEGORIES: 









Grp 


Grp 


Grp 










2 


3 


h 


-5 




CLASSROOM MANAGEMENT 


freq* 


89 


178 


63 


^9 


ioi : 


- . 

C.l 


Organization; be organized and reduce 


P. 


.09 


.05 


.u3 








^M RRr 00 m niaTiagHmenL time, pxri nn t ng^ 


rank 


2.5 


1 


*f 


5 




- 




freq. 


27 


76 






36 


C.2 


Use of time ; allocation of time to each 




.01 


.02 


.02 


.01 






activity, on o&5J£, avoiu ujljl uciois. 


rank 














Denavior • . 


freq. 


9 


12 


28 


8 


12 


C3 


Task involvement; "Time on Task." 


]?•___ 


# 




.01 


* 


• Ul 






rank 






1.3 










freq. 


13 


3 


1 


12 


38 


C.if 


Academic Learning Time (A.L.T.): students 




.01 






♦ 


no 




are . engaged or on tasK ana. woritiiig 


rank 










1 




an 80/6 success rate. 


freq. 


9 




88 


6*f 


11 


C5 


Forming groups and organxzing group 


XT • 


* 


* 




.03 


* 




activities. 


rank 


- 


- 


l 


2 


- 






freq. 


26 


- 5 


17 


13 


31 


C.6 


Intrusions , try to reduce them; intercom. 


P. 


.01 


* 


.01 


.01 


.01 






rank 


2,g 


— 5-- 










; - 


total 


175 


278 


240 


160 


229 






P- 


.07 


.08 


.11 


.06 


ilO 






rank 


*f 


3 


1 


5 


2 


















D. 


BEHAVIOR MANAGEMENT 


freq. 


7 


97 




18 


23 


D.l 


Student involvement; causing more student 


P- . 




.03 




.01 


.01 




responding; calling on an tne st/uctents, 


rank 




1 




2.5 


2.5 




oral responses. 


freq. 


^5 


120 


65 


78 


16 


D.2 


Rraising and supporting. 


P- - 


.02 


.03 


.03 


.03 


.01 






rank 




2 


2 


2 


5 






freq. 


12 


27 


12 


1 


17 


D.3 


Positive interactions; interactions, 


P- 


* . 


.01 


.01 


* 


.01 




smiling. 


rank 




2 


2 




2 






freq. 


9 


17 


11 


139 


3^ 


D.*f 


Motivating behavior; making students feel 


P- 


* 


* 


.01 


.06 


.01 




interested, successful; avoiding negative 


rank 






2.5 


1 


2.5 




statements; clarifying values. 


freq. 


. 27 


10 




26 


15 


D.5 


Socializing and social statemements are 


P- 


.01 


' * 


* 


.01 


.01 




to be avoided by the teacher. 


rank 


2 






2 


2 







freq. kk 213 31? 31 39 D.6 Behavior Management; disciplining; be- 
p. .02 .06 .15 .01 .02 havior statements. 



TRAINER REFERENCE TO CONTENT CATEGORIES: 





Grp 
1 


Grp 
2 


Grp 
3 


Grp 
if 


Grp 
5 


E. 


J?'iJKL)BACK AMD DIRECT INSTRUCTION 


freq. 


1 


8 


0 


1 


16 


E.i 


Enthusiasm; be enthusiastic , excited, 


P. 


* 


* 


* 


* 


.01 




involved i 


rank 


- 


- 


— 


— 


1 






freq. 


0 


38 


6 


19 


16 


S.2 


Questioning; use a variety of questions; 


P- 


* 


.01 


* 


.01 


.01 




how to ask questions w 


rank 


- 


2 


— 


2 


2 






freq. 


20 


17 


26 


26 


8 


E.3 


Direct questions are recommended^ 


P- . 


.01 


* 


.01 


.01 


* 






rank 


2 


- 


2 


2 








freq. 


i4 


57 


51 


16 


44 


E.4 


Clarifying questions are recommended^ 


P. 


.01 


.02 


.02 


.01 


.02 






rank 


4.5 


2 


2 


4.5 


. 2 






freq. 


56 


110 


18 


37 


52 


E.5 


Interactive instruction is recommended, 




.02 


.03 


.01 


.01 


.02 




riot teacher working alone. 


rank 


2.5 


1 


4.5 


4.5: 


2.5 






freq. 


33 


173 


31 


24 


50 


E.6 


Instruction and explanation; direct in- 


P- 


.01 


.05' 


.01 


.01 


.02 




struction; academic and content focus. 


rank 


4 


1 


4 


if 


2 






freq. 


6l 


61 


25 


36 


18 


E.7 


Giving feedback is recommended. 


P. 


.02 


.02 


.01 


-.01 


.01 






rank 


4.5 


4.5 


2 


2 


2 






ireq. 


21 


121 


10 


11 


1 


E.8 


Making assignments and giving homework. 


P- 


.61 


.03 


* 


* 


* 






rank 


2 


1 


- 


- 


- 






freq. 


26 


107 


4o 


38 


■ 15 


E.9 


Correcting and guiding; correction; selling 


P- 


,01 


.03 


.02 


.02 


,01 




the student that he or she is wrong. 


X CU.XXV 


if 5 


X 




2 5 


4.5 






freq. 


20 


if 


10 


6 


10 


E.10 Written assignments in class are not 


P- 


.01 


* 


* 


* 


* 




recommended. 


rank 


1 














freq. 


6 


36 


10 




8 


E.ll Monitoring written work is not recom- 


P- 


* 


.01 


* 


.01 ' 


* 




mended. 


rank 




1.5 




1.5 








total 


258 


732 


227 


238 


238 






P- 


.10 


.21 


.10 


.10 


.10 






rank 


3.5 


- 1 


3.5 


3.5 


3.5 







' ' 'to mark the tallies of the analysis. Each observer listened to only 

brio workshop of any one trainer, thus observer bias is evenly distributed 
across trainers. 

Similar to the findings in: the citation analysis, items which changed 
for each group of teachers, shown in table *f, when compared to discussion 
of the same item in the content analysis bore no noticeable relationship. 
The only exception to this was Group 2. In this group, the. classroom IMI 
variable, intrusion, increased, which was not supposed to happen. In 
the content analysis, Group 2 ranked last in discussing intrusions and 
how to cope with them. Among the Snapshot variables of table *f» Group 2 . ; - 
teachers made significant change in two of the variables, and the Group 2 
trainer also ranked highest in discussing these items, which were Making 
Assignments and Student Uninvolved. 

A broader view of the items in the content analysis compared to the 
overall ranks of the groups provides some useful information. Recall 
that the group ranks are Group 1 - rank k\ Group 2 - rank 2 ; Group 3 
- rank 3; Group k - rank 5, and Group 5 ~ rank 1= 

Among the Workshop Experience categories, several points are worth 
rioting. Item A. 4, which calls on teachers to relate their experiences 
and includes stroking, is apparently not a recommended trainer behavior 
because the two top local trainers, Groups 2 and 3. were the lowest ranked. For 
another item, A. 6 in which trainers give homework or try to change teacher 
behavior, Group 4 had the lowest proportion, about hal' of the other 
trainers. This may provide a clue as to why Group 4, which is similar 
to the other training groups oh other measures, resulted in the least 
teacher change: The trainer may not have tried as hard to change the 
teachers' behavior. And iteir A .10, the category of general frivolity and 

ERIC 
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* between having fun and changing. behavior, it could represent ah acceptance 
of one another, a camaraderie, or a recognizing of the difficulties fac- 
irig teachers without being overwhelmed by them- In the total of the 
Workshop Experience categories, Groups 2 arid 3 spent the least pro- 
portion of statements; apparently, they put their eiaphasis on the con- 
tent of training, not oh the communication processes and structure of 
the workshop. . 

Among the Strategies for Teaching Reading, Groups 2 and 3 ranked the 
highest on B.^ personalizing instruction and B. 14 readability formulas^ 
Groups 3 and 5 on B.10 reading aloud, and Groups 2 and 5 on B.2 using 
a variety of materials and B.5 group instruction. The important ob- 
servation about B.5 is that it also placed Group k in the bottom rank. 
This is probably one variable which is key for teachers who will be 
measured by the SRI Secondary Observation Instrument, 

. Two items Appear to fail in the "what not to do" -column. On these, 
the three top ranked groups were the lowest in discussing this material 
in their workshops. The items were B.3 assessing and teaching to student 
ability levels, arid B.12 teaching reading in the content areas. Group 4 
spent a lot of time discussing B.12, but the emphasis didn't appear to 
encourage teachers to change the ways they were teaching. Examining 
the totals for this area, it ddesn 1 t seem that emphasis on Strategies 
for Teaching Reading is that useful in changing teachers' behaviors. 

The area of Classroom Management is different. Here the rankirtgs on 
the categories closely match the group ranks of teacher changes. Spe- 
cifically, t,ie items which . rank Groups 2, 3 and 3 the highest and Group 4 
the lowest are 0.1 organization* C.2 careful -use of time, and C.3 time on 
task. C.6 intrusions has been noted earlier for Group 2. 



^9 

In the general and specific category of Behavior Management (D.6) 
Groups 2 ani 3 take a leading^role ; The emphasis and concentrated 
discussion on how to deal, with "behavior and discipline problems may 
have proven tb "be very useful to the teachers. The study of trainer 
citation found a similar relationship for the variable, All Behavior 
Statements. The other important category in this area is D;3 positive 
Interactions, which singled out the three top groups. 

The findings under the area, Feedback and Direct Instruction, are 
generally ambiguous; although Judging by the total, Group 2 chose to put 

O - . - . - ...... 

a much greater emphasis here, and Group 2 is the only orie to significantly 
change the structure of the classroom situation as illustrated in the 
Snapshot. Group 2 ranked first on E.2 questioning , E;4 using clarifying 
questions, E.5 using interactive instruction*, E.8 making assignments, 
E.9 correcting and guiding, and E. 11 avoiding monitoring. The one item 
which identified the three top groups was E.4 emphasis on using clarifying 
questions. 

In the methods employed in this content analysis, a comparison of 
ranks, simple probability would Indicate that the ranking of some of the 
items would correspond to any given ranking of the groups; However, 
there was a pattern to the items which matched the ranks, and there 
was some logic to why those items fell as they did. A replication of 
this analysis with a similar training program would be a valuable val- 
idation of the findings reported here. This analysis should be most 
useful to those who plan training groups and to trainers of teachers 
by identifying which areas should be stressed and which deemphasized. 
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CONCLUSION 

Observers as they listened to the workshop tapes made personal 
consents about other characteristics they had noted about the different 
training styles. In retrospect, some of these comments could provide 
valuable clues to the true dimensions separating the truly effective 
training approaches from those which -are not as effective. What this 
indicates in terms of this study is that a fifth analysis was needed, 
that of the observer participant - the person who just listens and 
makes notes about what he or she hears and how that might serve to 
encourage teachers to change. 

Some of the observers' comments and other information about these 
training groups might be useful in presenting a more complete picture 
of each trainer and her set of teachers. Another note in passing is 
that all the trainers receive?- very high ratings from the teachers 
on all the workshop feedback forms, and this strong positive feeling 
about the training persisted and was reported again in an evaluation 
a year later. 

Group 1 had only three teachers, which may have altered the train- 
er's role since she was among friends. More significantly, however, 
was the fact that one of her teachers had a class of academical ly ad- 
vanced students, thus many of the variables of training were not ap- 
propriate for change, and some workshop discussion had to be devoted 
to discussing the exceptions to the rules. One observer commented 
that Group 1 seemed to do a lot of reinforcing of what the teachers 
v; e re already doing and what they thought. The B. 0. Smith analysis 
picked this up in the Opining category •.. ' ; 
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Group 2, as noted by two observers -, had a lot of joking and laughing. 
This was also found by the Content Analysis. This trainer ma£e one im- 
portant statement from the perspective of changing teacher attitudes 
shd behavior: In discussing the criterion as a goal for teachers on 
one variable she said, "The criterion is 50, but you are all so good, 
that we are going to try for ?0." 

Iri Group 3 during the workshop in which teachers reported on their 
experiences trying to •improve two variables in their classrooms, this 
trainer devoted a large amount of time to these reports — what the 
teachers had tried and how it had worked. The message of this emphasis 
was that the teachers were expected to try to change, and that they 
would be held accountable to the group for what they tried. 

The Group k trainer was described by one observer as a counselor 
type who used a lot of stroking. Qn many of the measures of this study 
Group 4 fell in the middle of the ranges, yet these teachers changed 
the least. The clue may be in some of the comments early in training. 
The trainer asked teachers to introduce themselves and in so doing to 
state what they "would be able to contribute to the training." This 
is a good technique for causing people to support a program but not 
for inducing them to change. At another point the trainer reminded 
them that they were "the cream of the crop." Again, it's reinforcing, 
but may not encourage them to change. The clue may be something more 
direct, however ~ just a simple mistake in bringing about attitude 
and behavioral change: During the workshop in which the teac^rs were 
to select iwo variables to work on that week, the trainer did not 
require that they' state publicly which variables those would be. A 
public commit merH to change is an important incentive to cause people 
to change. In terms of available time in a time-on-task model, Group k 
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was the shortest. One workshop was cut short by bsd weather i and 
when another workshop had to he made up* it took place. in a school in 
which the intercom "boomed every ten minutes (so it seemed)* and recess 
seemed to take place in the same room with the tape recorder. The con- 
ditions were not conducive to good training and the workshop was cut * 
short. 

_ _ 

Group 5 vas trained by the consultant; eleven teachers participated . 
while the four other trainers, who were also supervisors to these 
teachers, observed from the back. One observer commented that this 
trainer seemed to be "straight out of Flanders," which might be valid 
if based on the high percentage of teacher talk in this training. The 
consultant had her comments most strongly 'grounded In the research, 
as verified by the Content Analysis, and she also strongly encouraged 
the teachers to change. In the final workshop she kept reminding the 
teachers that after the post observations* there would be a follow-up 
meeting at which time she could see how well they had all done. They 
responded since as a group they changed on the post observations the 
most. 

In assessing the relative contributions of the four methods of 
observation used in this study, some of the basic assumptions under- 

_ . . . . . : 

lying the ranking of the groups come into question. The magnitude of 

change based upon an analysis of covariance was used. The problems of 

covariance were generally controlled by the use of rank equivalents. 

No reference was made to whether some variables might be more significant 

# 

than others. 

This method took no recognition of the variables which significantly 
changed within each training group and no recognition that Group 2 was 
the only group to change the Snapshot ; variables ; An assertion of this: 

O 
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paper, as yet unverified, is that the change in the Snapshot variables 
indicates that the teachers have restructured their classrooms and have 
allotted different proportions of time to activities; 

Ah examination of results of the four analyses for Group 5, which 
• ranked highest- in teacher change, shows that Croup 5 remained undis- 
tinguished except in having "the greatest proportion of teacher talk. 
This group fell in the middle of the pack cn many of the measures. 
This trainer was the consultant, the model for other trainers. It 
would be interesting to discover if the master trainer in fact usually 
models the typical behavior of training rather than an extreme behavior. 
Perhaps the magnitude of teacher change was due to the effects of the 
prestige of the consultant herself, not due to her methods,, style or 
content of training. 

If it is accepted, that the change in the "teachers in Group 5 was 
due to the training methods of the consultant, then these four -methods 
of analysis (except. Flanders on percentage of teacher talk) were not able to 
distinguish those effective training techniques. On the other hand, 
if it is accepted that something beyond the scope of these methods 
caused the teacher change, namely the effect of the consultant's prestige, 
then the four methods can present a strong picture of the most effective 
training model for teacher change. 

This picture of an effective training model, specifically Group 2, 
must be coupled with the assumption that the Snapshot variables were 
measuring the true order of change. The model for effective training 
which emerges and is partially verified by having characteristics similar 
to Group 3 but dissimilar to Group 4 is: From Flanders, a trainer who 
.does most of the talking, has frequent exchanges with the teachers and 
■ Vus. S a lot of praise, from the Trainer Citation, a trainer: « stresses. 
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the content of training by making frequent reference to the variables 
on "which the teachers will he observed; from the B. 6. Smith Analysis, 
a trainer who wants: short answers focused on the discussion without 
much elaborating or giving opinions, and from the Content Analysis, 
a trainer who de-emphasizes Workshop Experience categories? but stresses 
certain categories within Strategies for Teaching Beading, Behavior 
Wrisagement, Classroom Management and especially Feedback and Direct 
Instruction. The trainer also laughs a lot. 

The different observation methods each made a contribution to un- 
derstanding the most effective model for teacher training. The most 
accurate predictor of resulting teacher change was the total number of 
Trainer Citations of the Observation Variables, but the framework for . 
the model, the structure of the trainer's interactions, relied upon the 
Flanders i&atrix* B. 0. Smith's analysis gave a glimpse into the processes 
that take place between the trainer and teachers arid how a teacher is 
induced to change, and finally, the Content Analysis identified those 
areas of training which appfear to be most useful to teachers to enable 
them to change their teaching behaviors. Each analysis made its own 
distinct, yet complementary contribution to developing a model for 
effective teacher training. 
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DOES T1ME-ON-TASK WORK 
FOR TEACHER TRAINING TOO? - ; 

This study compared the results of four different methods of observing 
teacher training. In addition, it used the results to identify those training 
techniques -which seemed to be "better at changing teachers' behaviors in their 
classrooms. 

Twenty-nine teachers in the District of Columbia Public Schools were trained 
by five trainers, in five weekly training sessions, which were tape recorded. 
The recordings were analyzed using these observation methods: 1) Trainer 
Citation of Observation Variables, 2) Flanders Interaction Analysis, 2) 
B. 0. Smith's Analysis of the logic of Teaching, and k) Content Analysis. 
The dependent variable was based upon pre- and post training observations 
of the teachers in their own classrooms. • ; - 

The study found that among the local trainers, the one who dominated 
discussion, used frequent interactions, praise and laughter, and maintained 
an academic focus was the most effective. The' findings of the four observation 
methods, while consistent, revealed different facets of the training experience. 



